Test-Only Learning via Virtual Patients to Improve Surgical Illness Scripts of Preclinical Medical Students as a Preparation for Clinical Clerkships: An Experimental Study.

OBJECTIVE: The aim was to determine whether preclinical medical students can develop their illness scripts to a level comparable to that of clerkship students through test-only learning using repeated formative online testlets. METHODS: In this experimental study, participants were 52 preclinical and 53 clinical medical students. The intervention group consisted of preclinical medical students, and the control group consisted of clinical medical students. The intervention group responded to online testlets containing feedback, an innovative formative assessment method called ContExtended Questions, on general surgery for 8 days by spending no more than 30 minutes each day. The control group completed the general surgery clerkship. The performances were assessed using 20 Key-Feature Question items. The intervention group was assessed twice: immediately after the intervention (the immediate test), and again 1 month later (the delayed test). The control group was assessed once, immediately after the clerkship. All performance tests were identical. RESULTS: The preclinical students had a significantly higher mean score on the immediate test (83.1 ± 9.6) compared to the clinical students (75.4 ± 8.9), P < .001. The effect size (Cohen's d) was .83. However, the mean score in the delayed test (76.9 ± 13.6) was not significantly different from clinical students' mean score (75.4 ± 8.9), P > .05. CONCLUSIONS: Test-only learning as a spaced repetition of online formative testlets is effective in preparing preclinical medical students to the clinical clerkship. Through using this approach in preclinical period, they can prepare themselves for the clinical environment to optimize the benefits derived from clerkships.

Employment Preferences of Cardiologists in Türkiye: A Discrete Choice Experiment.

OBJECTIVE: The homogeneous distribution of physicians is important for ensuring patients' access to health services. To encourage physicians to work in underserved areas, policymakers create incentives. Understanding physicians' employment preferences is essential when developing these incentive packages. This study aims to quantitatively reveal the preferences of cardiologists in Türkiye using a discrete choice experiment (DCE). METHODS: A DCE questionnaire was distributed electronically to all cardiologists in Türkiye. It included 14 different pairs of hypothetical job offers based on seven parameters likely to influence their employment preferences. The data were analyzed using a conditional logit model. The coefficients (CEs) of conditional logistic regression and the willingness-to-accept (WTA) values were calculated. RESULTS: The analysis included 278 cardiologists. It revealed that the most influential parameter was location (CE: 2.86). To move to an undesirable location, the average participant would require an earnings increase of at least 123.3% relative to the average potential earnings of a cardiologist. Other parameters included availability of suitable facilities (CE: 1.07, WTA: 46.3%), harmony with co-workers (CE: 0.92, WTA: 39.61%), working conditions (CE: 0.68, WTA: 29.26%), and the number of night shifts (CE: 0.61, WTA: 26.34%). CONCLUSION: 'Location' emerged as the most important factor in the employment preferences of cardiologists in Türkiye. However, several other monetary and non-monetary factors were also influential, suggesting that policymakers should adopt a holistic approach when developing incentives for cardiologists.

ChatGPT to generate clinical vignettes for teaching and multiple-choice questions for assessment: A randomized controlled experiment.

AIM: This study aimed to evaluate the real-life performance of clinical vignettes and multiple-choice questions generated by using ChatGPT. METHODS: This was a randomized controlled study in an evidence-based medicine training program. We randomly assigned seventy-four medical students to two groups. The ChatGPT group received ill-defined cases generated by ChatGPT, while the control group received human-written cases. At the end of the training, they evaluated the cases by rating 10 statements using a Likert scale. They also answered 15 multiple-choice questions (MCQs) generated by ChatGPT. The case evaluations of the two groups were compared. Some psychometric characteristics (item difficulty and point-biserial correlations) of the test were also reported. RESULTS: None of the scores in 10 statements regarding the cases showed a significant difference between the ChatGPT group and the control group (p > .05). In the test, only six MCQs had acceptable levels (higher than 0.30) of point-biserial correlation, and five items could be considered acceptable in classroom settings. CONCLUSIONS: The results showed that the quality of the vignettes are comparable to those created by human authors, and some multiple-questions have acceptable psychometric characteristics. ChatGPT has potential in generating clinical vignettes for teaching and MCQs for assessment in medical education.

ChatGPT for generating multiple-choice questions: Evidence on the use of artificial intelligence in automatic item generation for a rational pharmacotherapy exam.

PURPOSE: Artificial intelligence, specifically large language models such as ChatGPT, offers valuable potential benefits in question (item) writing. This study aimed to determine the feasibility of generating case-based multiple-choice questions using ChatGPT in terms of item difficulty and discrimination levels. METHODS: This study involved 99 fourth-year medical students who participated in a rational pharmacotherapy clerkship carried out based-on the WHO 6-Step Model. In response to a prompt that we provided, ChatGPT generated ten case-based multiple-choice questions on hypertension. Following an expert panel, two of these multiple-choice questions were incorporated into a medical school exam without making any changes in the questions. Based on the administration of the test, we evaluated their psychometric properties, including item difficulty, item discrimination (point-biserial correlation), and functionality of the options. RESULTS: Both questions exhibited acceptable levels of point-biserial correlation, which is higher than the threshold of 0.30 (0.41 and 0.39). However, one question had three non-functional options (options chosen by fewer than 5% of the exam participants) while the other question had none. CONCLUSIONS: The findings showed that the questions can effectively differentiate between students who perform at high and low levels, which also point out the potential of ChatGPT as an artificial intelligence tool in test development. Future studies may use the prompt to generate items in order for enhancing the external validity of the results by gathering data from diverse institutions and settings.

Case-based MCQ generator: A custom ChatGPT based on published prompts in the literature for automatic item generation.

WHAT IS THE EDUCATIONAL CHALLENGE?: A fundamental challenge in medical education is creating high-quality, clinically relevant multiple-choice questions (MCQs). ChatGPT-based automatic item generation (AIG) methods need well-designed prompts. However, the use of these prompts is hindered by the time-consuming process of copying and pasting, a lack of know-how among medical teachers, and the generalist nature of standard ChatGPT, which often lacks the medical context. WHAT ARE THE PROPOSED SOLUTIONS?: The Case-based MCQ Generator, a custom GPT, addresses these challenges. It has been trained by using GPT Builder, which is a platform designed by OpenAI for customizing ChatGPT to meet specific needs, in order to allow users to generate case-based MCQs. By using this free tool for those who have ChatGPT Plus subscription, health professions educators can easily select a prompt, input a learning objective or item-specific test point, and generate clinically relevant questions. WHAT ARE THE POTENTIAL BENEFITS TO A WIDER GLOBAL AUDIENCE?: It enhances the efficiency of MCQ generation and ensures the generation of contextually relevant questions, surpassing the capabilities of standard ChatGPT. It streamlines the MCQ creation process by integrating prompts published in medical education literature, eliminating the need for manual prompt input. WHAT ARE THE NEXT STEPS?: Future development aims at sustainability and addressing ethical and accessibility issues. It requires regular updates, integration of new prompts from emerging health professions education literature, and a supportive digital ecosystem around the tool. Accessibility, especially for educators in low-resource countries, is vital, demanding alternative access models to overcome financial barriers.

Effectiveness of using 2D atlas and 3D PDF as a teaching tool in anatomy lectures in initial learners: a randomized controlled trial in a medical school.

BACKGROUND: Anatomy is a crucial part of medical education, and there have been attempts to improve this field by utilizing various methods. With the advancement of technology, three-dimensional (3D) materials have gained popularity and become a matter of debate about their effectiveness compared to two-dimensional (2D) sources. This research aims to analyze the effectiveness of 3D PDFs compared to 2D atlases. METHODS: This study is a randomized controlled trial involving 87 Year-1 and Year-2 medical students at Gazi University Faculty of Medicine, Turkey. The study was conducted in two steps. In Step-1, students were randomized to watch lecture videos on liver anatomy and male genitalia anatomy supplemented with either a 3D PDF (intervention group) or 2D atlas (control group) images. Following the video lectures, a test (immediate test) was administered. In Step-2, the same test (delayed test) was administered 10 days after the immediate test. The test scores were compared between the intervention and control groups. In addition to the descriptive analyses, Chi-square and Mann-Whitney U tests were performed. RESULTS: In the immediate test, while there was no significant difference between the groups for the liver test (p > 0.05), 3D PDF group's scores (Median = 24.50) was significantly higher than the 2D atlas group's in the genitalia test (Median = 21.00), (p = 0.017). The effect size (Cohen's d) was 0.57. In the delayed test, there was no significant difference between the groups in the liver and genitalia tests (p > 0.05). However, the effect size in the immediate genitalia test was 0.40. Year-1 students' immediate test of genitalia performances were significantly higher in the 3D PDF group (Median = 24.00) than the 2D atlas group (Median = 19.00), (p = 0.016). The effect size was 0.76. Also, Year-1 students' 3D PDF group (Median = 20.50) presented with significantly higher performance than the 2D atlas group (Median = 12.00), (p = 0.044) in the delayed test of genitalia, with the 0.63 effect size. CONCLUSION: 3D PDF is more effective than 2D atlases in teaching anatomy, especially to initial learners. It is particularly useful for teaching complex anatomical structures, such as male genitalia, compared to the liver. Hence, it may be a valuable tool for medical teachers to utilize during lectures.

How does evidence-based medicine training affect medical students' views on traditional, complementary, and alternative medicine and the conspiracy theories about COVID-19: a nationwide study.

AIM: It was aimed to explore the relationship between evidence-based medicine (EBM) training and medical students' views on traditional, complementary, and alternative medicine (TCAM) and their views on conspiracies about COVID-19. BACKGROUND: Medical students constitute the future workforce of primary health care services. The relationship between EBM training and their views on conspiracies about COVID-19 is critical to explore for providing a better primary health care. The relationship EBM training and medical students' views on TCAM is also important in this regard. METHODS: This is a cross-sectional study. Turkish medical students were surveyed about EBM training, TCAM, and COVID-19 conspiracies. The electronic survey form consisted of five parts: Demographic characteristics, views and self-perceived knowledge about TCAM and the methods, views on the origin of SARS-COV-2, participation in EBM training, and views on TCAM training. A total of 49 medical schools provided response. Along with descriptive statistics, Chi-square test was utilized. FINDINGS: Among 2577 participants, 24.0% of them believed SARS-COV-2 was artificially designed. The students who have participated in EBM training via both lecture and small group discussions have a less positive view on TCAM than both the students who have not participated in any EBM training (p < 0.05) and the students who participated in only-lectures (p < 0.05). There was a significant association between EBM training and whether believing COVID-19 (SARS-COV-2) has been designed purposefully by some people or it has emerged naturally χ2 (1) = 17.21 p < 0.001. The odds of thinking COVID-19 emerged naturally was 1.85 times higher (95% CI: 1.38-2.47) if the students have participated in EBM training via both lectures and small group discussions than if they have not participated in any EBM training. EBM training affects medical students in terms of beliefs on COVID-19 conspiracies.

Exploratory Factor Analysis of a Computerized Case-Based F-Type Testlet Variant.

A testlet is a cluster of questions related to a single content area. F-type testlet is a specific type of linear testlets that contains evolving scenarios. There is no study that carried out a factor analysis of an F-type testlet exam in the context of medical education and related disciplines. We aimed to determine to what extent disciplinary domains account for the variability of student performance on an online case-based F-type testlet variant. Final year undergraduate medical students (N = 441) participated in the online exam that consisted of ten case-based F-type testlets. Six of the testlets were pediatrics, four were internal medicine. Exploratory factor analysis was carried out. It revealed that the structure has two factors. Pediatrics testlets loaded factor 1 (loadings between 0.56 and 0.77), and internal medicine testlets loaded factor 2 (loadings between 0.65 and 0.79). The results showed that disciplinary domains account for the variability of the performance on F-type testlets. The results suggest that context specificity still exists in this type of exam. In order to more thoroughly evaluate the clinical reasoning skills of students, medical educators must still ensure that clinical reasoning exams include a comprehensive representation of all relevant content areas.

The effect of watching lecture videos at 2× speed on memory retention performance of medical students: An experimental study.

AIM: This study aimed to determine how watching lecture videos at 1× and 2× speeds affects memory retention in medical students. METHODS: A posttest-only experimental design was utilized. The participants were 60 Year-1 and Year-2 medical students. The participants were assigned to one of two groups through stratified randomization: Group 1 would watch the video at 1× speed, and Group 2 at 2× speed. Their performance was assessed using a test comprising 20 multiple-choice questions. The test has been applied immediately after watching the video (Immediate test), and, again after one week (Delayed test). Parametric and non-parametric statistical tests were performed. RESULTS: In the Immediate test, the mean score of the 1× speed group was 11.26 ± 4.06, while 2× speed group's mean score was 10.16 ± 2.46. The difference was not significant t(58) = 1.26, p > .05. In the Delayed test, the mean score of 1× speed group was 9.66 ± 3.94, while 2× speed group's mean score was 8.36 ± 2.80. The difference was not significant t(55) = 1.42, p > .05. CONCLUSIONS: Watching the video lecture at 2× speed did not impair memory retention in medical students. This may help students to save time in their dense curricula.[Box: see text].

Validation of IFMSA social accountability assessment tool: exploratory and confirmatory factor analysis.

BACKGROUND: IFMSA Social Accountability Assessment Tool has been developed for medical students by medical students to assess medical schools. However, its psychometric characteristics are unknown since it was developed without any analysis. We aimed to reveal its reliability and validity. METHODS: 1122 undergraduate medical students from various years in Gazi University Faculty of Medicine have participated in the study. They have answered the Turkish version of IFMSA Social Accountability Assessment Tool created through a translation process by experts. Exploratory and confirmatory factor analyses were carried out. RESULTS: Exploratory factor analysis showed that factor loadings were between 0.46 and 0.73 for Factor 1, 0.68 and 0.87 for Factor 2. The two-factor model, which consists of "Community Centeredness" and "Socio-Demographic Characteristics", was evaluated through confirmatory factor analysis. The goodness-of-fit statistics of the model showed well-fit: CMIN/df 4.46, GFI 0.96, CFI 0.95, RMSEA 0.05, SRMR 0.03. Standardized regression weights were between 0.43 and 0.77. CONCLUSION: The tool has acceptable psychometric characteristics, with good reliability and validity. It could be considered as a point of departure for the change in the way of being socially accountable since it enables medical students to explore the weak areas of their medical schools in terms of social accountability.

Teaching rational prescribing in undergraduate medical education: a systematic search and review.

AIM: This study aimed to reveal the current status of the literature on rational prescribing training in undergraduate medical education. METHODS: This study followed the preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines. An online search using 50 keywords in four databases was performed to access the studies published between 2008 and 2020. Specific features of the training such as aims or objectives of teaching, methods or model, and evaluation of effectiveness were extracted. Kirkpatrick levels were used to evaluate the effectiveness of teaching. RESULTS: Of 74 studies included in the full review, 16 (21.6%) of them reported the use of WHO 6-Step Model for Rational Prescribing in their educational interventions. In terms of effectiveness, only two of the studies investigated changes in learner behavior in the context for which they are being trained, and only one study showed the effect of training on patient outcomes. CONCLUSION: The evidence on the effectiveness of rational prescribing training has been presented mostly by using student satisfaction surveys and test of knowledge and skills. A higher level of evidence such as patient outcomes of the training needs to be reported.

What do Turkish, Spanish, and Pakistani medical students value in specialty training positions? A discrete choice experiment.

BACKGROUND: The aim of this study was to find out specialty training preferences of senior medical students from three medical schools in Turkey, Spain, and Pakistan. METHODS: A Discrete Choice Experiment was carried out using an electronic form for students in three countries in 2021-2022 term. Each choice set in the form consisted of two hypothetical specialty training positions. The attributes were location, earnings, working conditions, personal perspective, quality of education, probability of malpractice, and prestige. Conditional logit model was used to estimate participants' preferences and "willingness to accept" values. RESULTS: The most valued attribute was "personal perspective on specialty area" for Turkish and Spanish students, while this attribute was not meaningful for Pakistani students. Turkish students needed a 204% of change in their income for a swap between the specialty that they like and not like. This tradeoff necessitated a 300% change for Spanish students. The most valued attribute for Pakistani students, which was "working conditions", necessitated a 97% increase in income to switch from working in good conditions to working in poor conditions. CONCLUSION: In this first multinational DCE study in the medical education literature, we found the preferences of medical students in Turkey, Spain, and Pakistan are affected to various extents by several factors.

Telemedicine curriculum in undergraduate medical education: a systematic search and review.

The number of patient-doctor appointments carried out using telemedicine has surpassed in-person appointments. In spite of this, it is unclear that telemedicine curricula in undergraduate medical education reflect the real importance by means of the effectiveness of these approaches. We aimed to systematically search and review the studies that are on undergraduate telemedicine curricula. We searched the Web of Science, PubMed, and Scopus using the keywords such as telemedicine, medical education, and curriculum. Our search was limited to publication dates between January 1, 2000, and February 1, 2020. We elicited the information of the curricula as to their countries, participants, aims or objectives, teaching methods, and evaluation of effectiveness. We also evaluated the quality of the studies using the Joanna Briggs Institute Qualitative Appraisal and Review Instrument. Out of 461 studies, seven articles were selected based on selection criteria for further review. The studies were mostly from the USA. The participant numbers were between seven and 268. There were several modes of delivery but lectures and patient encounters were used mostly. In four studies, the effectiveness was evaluated only by using satisfaction surveys, and the results were satisfactory. A study reported the acquisition and application of skills as a result. There is no well-established telemedicine curriculum in the undergraduate years. The methods vary but the effectiveness of the educational programs does not have a robust evidence base. It is evident that undergraduate medical education needs a curriculum backed by strong scientific data on its effectiveness.

From Copyright to Copyleft to CopyCovid: An opportunity for democratization of medical education.

This article was migrated. The article was marked as recommended. The COVID-19 (Coronavirus Disease of 2019) pandemic, as the modern world's gravest health crisis, has rapidly required more health facilities and health care providers (HCPs). The education system in general and medical education, in particular, has also changed dramatically with the school closures. Teaching and learning activities are undertaken remotely and on digital platforms. Academicians, HCPs, and medical students have gained new skills and experienced to manage their own learning process online. Many sources became easily reachable, open, and free. Open and democratized medicine, as we have seen during this pandemic, offers an interactive, egalitarian educational model. Governments, global organizations, and companies collaborated in order to keep all students learning and all instructors teaching. Many societies are faced with the digital divide and exclusion of learners. In this paper, we discussed the effect of COVID-19 on medical education at all levels and its' democratization and shared our recommendations for sustaining these achievements after the pandemic.